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ERROR HANDLING SCHEME FOR TIME-CRITICAL PROCESSING 

ENVIRONMENTS 

Technical Field 

[0001] The present disclosure relates to error handling in time-critical 
and/or time-bounded processing environments. 

Background 

[0002] In time-critical processing environments, it is important to add 
predictability to the error compensation process. This is especially 
important in situations where the processing time may affect the 
safety of people and/or equipment, such as applications involving 
vehicular displays and controls. For example, in applications involving 
the update and display of information on an aircraft, it is crucial that 
errors that affect the accuracy and integrity of the display are 
compensated for quickly and predictably. 

[0003] One approach to this challenge is to provide frequent feedback 
between logic layers of the processing environment. For example, a 
graphics display application may frequently interact with a graphics 
display driver, which may in turn frequently interact with a graphics 
subsystem. Each or most interactions of the graphics application with 
the graphics driver may involve the return of error and/or status 
information to the graphics application. If an error occurs in the 
graphics subsystem or graphics driver, the graphics application 
quickly gains notice of this situation and may adjust its behavior, or 
the behavior of the system it controls, accordingly. A problem with this 
approach is that returning error and status information for each or 
most interactions between logical layers of a processing system may 
degrade performance. 

Summary 

[0004] The following summary is intended to highlight and introduce 
some aspects of the disclosed embodiments, but not to limit the 
scope of the invention. Thereafter, a detailed description of illustrated 
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embodiments is presented, which will permit one skilled in the 
relevant art to make and use aspects of the invention. One skilled in 
the relevant art can obtain a full appreciation of aspects of the 
invention from the subsequent detailed description, read together with 
the figures, and from the claims (which follow the detailed 
description). 

[0005] As a result of detecting a device error, calls to device driver logic 
are redirected to substantially reduce processing time of the driver 
logic and to return to the caller without providing an indication of the 
error. The driver logic may be display driver logic. When there is no 
error, command routing logic directs calls to command processing 
logic of the driver logic. However, upon detecting an error, the routing 
logic is reconfigured to return processing to the application logic 
without invoking substantial processing by the command processing 
logic and without providing an indication of the error. Thus application 
logic may continue to make calls to the driver logic after detection of 
the error. The application logic may act to correct the error; and 

[0006] as a result of correcting the error, the routing logic may be 

reconfigured to once again direct calls from the application logic to the 
command processing logic. 

Brief Description of the Drawings 

The headings provided herein are for convenience only and do 
not necessarily affect the scope or meaning of the claimed invention. 

In the drawings, the same reference numbers and acronyms 
identify elements or acts with the same or similar functionality for 
ease of understanding and convenience. To easily identify the 
discussion of any particular element or act, the most significant digit 
or digits in a reference number refer to the figure number in which that 
element is first introduced. 

Figure 1 is a block diagram of an embodiment of a data 
processing arrangement. 
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[0010] Figure 2 is a block diagram of an embodiment of a graphics 

processing hierarchy. 
[0011] Figure 3 is an action diagram of an embodiment of a graphics 

processing scheme. 

5 [0012] Figure 4 is an action diagram of an embodiment of error handling 
for a graphics processing scheme. 
[0013] Figure 5 is a block diagram of an embodiment of a logical 

arrangement for a graphics processing scheme. 
[0014] Figure 6 is an action diagram of an embodiment of error handling 
10 for a graphics processing scheme. 

[0015] Figure 7 is a block diagram of an embodiment of a logical 
arrangement for a graphics processing scheme in which an error 
condition has arisen. 
[0016] Figure 8 is a timing diagram embodiment comparing application 
15 and driver processing times for normal and error conditions. 

Detailed Description 
[0017] The invention will now be described with respect to various 

embodiments. The following description provides specific details for a 

20 thorough understanding of, and enabling description for, these 

embodiments of the invention. However, one skilled in the art will 
understand that the invention may be practiced without these details. 
In other instances, well known structures and functions have not been 
shown or described in detail to avoid unnecessarily obscuring the 

25 description of the embodiments of the invention. References to "one 

embodiment" or "an embodiment" do not necessarily refer to the 
same embodiment, although they may. 
[001 8] Figure 1 is a block diagram of an embodiment of a data 

processing arrangement. A data processing device 102 (such as a 

30 vehicular display system) comprises a processor 1 04 and various 

types of memory. The types of memory may include a processor 
cache 106, volatile random access memory (RAM) 108, and non- 
volatile RAM 110 (read-only memory, magnetic and optical discs or 
other media, flash memory, and so on). The data processing device 
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102 may also comprise other logic and circuits 1 12 to perform 
processing that is not central to the present discussion. 

[0019] The data processing device 1 02 comprises a graphics subsystem 
1 14 that includes memory 1 16, display logic and circuits 118, and a 
graphics processor 119, among other things. 

[0020] The volatile RAM 1 08 may comprise logic 1 20 that, when applied 
to the processor, results in collection, configuration, and display of 
graphics information. At any particular time, portions/versions 122 of 
the logic 120 may be comprised by non-volatile RAM 110. Likewise, 
the cache 106 may at times comprise portions/versions of the logic 
120. 

Graphics information may be provided to and stored by the 
memory 1 16 of the graphics subsystem 114. The graphics information 
may be configured such that applying the graphics information to the 
display and logic circuits 118 results in a visually informative graphical 
display. Both the processor 104 and the graphics processor 119 may 
provide configuration of the graphics information. For example, the 
logic 120 may influence the processor 104 to invoke the graphics 
processor 1 19 to perform graphics configuration operations. 

The data processing device 102 may be a system of devices 
including multiple sensors, processors, displays, graphics 
subsystems, and other circuits and devices. 

Figure 2 is a block diagram of an embodiment of a graphics 
processing hierarchy. Application logic 202 communicates with 
graphics driver logic 206. The graphics driver logic 206 communicates 
with the graphics subsystem 1 14 to configure graphics memory 116 
and/or cause the graphics processor 1 19 to configure the graphics 
memory 1 1 6. Application logic 204 also communicates with graphics 
driver logic 206. In other words, multiple applications may 
communicate with and utilize a single graphics driver. The application 
logic 202, 204 is any logic that invokes the graphics driver logic 206, 
e.g. that causes the graphics driver logic 206 to be applied to affect 
the data processing device 102. Often, the application logic 202, 204 
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operates at a lower privilege level than the graphics driver logic 206. 
That is, the application logic 202, 204 may not affect certain 
operations, such operations of the graphics subsystem 114, that may 
be carried out by the graphics driver logic 206. 

[0024] Typically, the application logic 202,204 invokes "high level" 
graphics operations of the graphics driver logic 206. Examples of 
high-level graphics operations include "draw line", "fill region", "draw 
polygon", and so on. In real-time display systems, the application 
logic 202, 204 may invoke graphics operations to configure and 
display a "frame" of graphics information, that is, a periodic (often 30- 
60Hz) replacement or update of all or a portion of the graphics 
information presently displayed. Interruptions and/or errors in the 
periodic update and display of frames may result in the display of 
erroneous, distorted, and/or out of date information, or "blackout" 
periods where no information is displayed. This is a serious concern 
in vehicular display and control environments. 

[0025] The graphics driver logic 206 invokes "low level" graphics 

operations of the graphics subsystem 1 14 to carry out the high level 
operations of the application logic 202, 204. The graphics driver logic 
206 thus simplifies the design of the application logic 202, 204 by 
enabling high level graphics operations and by managing 
communication to the graphics subsystem 114 from multiple 
applications 202, 204. 

[0026] Processing and operational errors in the graphics subsystem 

1 14 may be communicated to or detected by the graphics driver logic 
206 at or near the time that the errors occur. However, in high- 
performance environments it may be inefficient to communicate errors 
to the application logic 202, 204 at or near the time that the errors 
occur, due in part to the fact that there may be many applications in 
process, and also due to other factors. For similar reasons it may be 
inefficient for the application logic 202, 204 to attempt to detect errors 
in the graphics subsystem 1 14 at or near the time that the errors 
occur. Thus, the application logic 202, 204 may continue to invoke the 
graphics driver logic 206 for a significant interval of time after an error 
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condition has arisen, leading to inefficient processing that can 
degrade system performance. For example, an error may occur early 
in the configuration of a frame, but the application logic 202, 204 may 
not detect the error until it has attempted to configure the entire frame 
by continuing to invoke the graphics driver logic 206. This may leave 
little time to recover from the error (for example, by reconfiguring the 
frame or switching to a backup display scheme) before the frame is 
due for display. 

[0027] Figure 3 is an action diagram of an embodiment of a graphics 
processing scheme. At 302 application logic invokes processing by 
the graphics driver logic. The invocation may take the form of a 
"command", e.g. directing the processor 104 to an instruction of the 
graphics control logic associated with particular processing. For 
example, a "fill" command by the application logic may direct the 
processor 104 to the first instruction of the graphics driver logic that is 
involved with causing the graphics subsystem 1 14 to fill a region of 
the display. In some embodiments a command may take the form of a 
"function call", "procedure call", or other form of call. 

[0028] At 304 the graphics driver provides a device command (typically 
a low level graphics command) to the graphics subsystem. Often, a 
single high level command from the application results in multiple low 
level commands from the driver to the graphics subsystem. At 306 the 
graphics subsystem configures a buffer according to the device 
command from the graphics driver. The contents of the buffer may 
affect the operation of the display logic and circuits 118 (e.g. the 
buffer is the current "display buffer). Often, in frame-based 
processing environments, the buffer is a region of the graphics 
memory 1 1 6 that may affect the operation of the display logic and 
circuits 118, but only after a change to the configuration of the 
graphics subsystem 1 14 (e.g. the buffer is an "off-screen" or "swap" 
buffer). Affecting this change to cause the buffer to become the 
display buffer is referred to as a "screen swap" or "buffer swap". 

[0029] At 308 the application provides another graphics command to 
the graphics driver, and at 310 the graphics driver provides (one or 
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more) device commands to the graphics subsystem in response. At 
312 the graphics subsystem configures the buffer accordingly. This 
process repeats for a third graphics command at 314, 316, and 318. 

[0030] At 320 the application provides a display frame command to the 
graphics driver, which at 322 provides set display (swap) buffer 
command to the graphics subsystem. At 324 the graphics subsystem 
waits for the next appropriate interval to display the frame, which is 
often the next vertical blanking interval (VBI). At 326 the graphics 
subsystem sets the display buffer to the buffer, resulting in display of 
the frame configured by the application. 

[0031] At 327 the application provides a command to query the status 
of the graphics subsystem and graphics driver. At 328 the graphics 
driver provides device status to the application. At this time the 
application may detect any errors that occurred during configuration 
of the frame. 

[0032] Figure 4 is an action diagram of an embodiment of error handling 
for a graphics processing scheme. A device command provided at 
304 from the graphics driver to the graphics subsystem results in an 
error at 402. At 404 the graphics subsystem provides an error 
indication to the graphics driver. The error situation is not 
communicated to the application, e.g. the invocation to the driver 
does not include a mechanism for returning a result of the driver's 
operations to the application. Thus, at 308 the application provides 
another graphics command to the graphics driver. At 406 the graphics 
driver detects the error situation that occurred previously, and thus 
does not invoke the graphics subsystem. At 314 the application 
provides another graphics command to the graphics driver, and once 
again, at 408, the graphics driver detects the error situation. Thus, the 
graphics driver continues to receive graphics commands from one or 
more applications, and repeatedly is called upon to detect the prior 
error situation and operate accordingly (e.g. by not invoking the 
graphics subsystem). 

[0033] At 320 the application provides a display frame command to the 
graphics driver, and at 326 the application provides a query device 
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status command to the graphics driver. At 410 the graphics driver 
provides an error indication to the application. The application may 
then proceed to attempt to recover the frame and/or perform other 
recovery operations. However, valuable processing time has been 
consumed by the repeated invocations to the graphics driver, where 
the graphics driver repeatedly detected the error condition and 
operated accordingly. 

[0034] Figure 5 is a block diagram of an embodiment of a logical 

arrangement for a graphics processing scheme. The graphics driver 
logic 206 comprises first application level graphics driver logic 506 
and kernel driver logic 512. The application level graphics driver logic 
506 executes at a same privilege level as the application logic and 
may execute as library code linked statically and/or dynamically with 
first application logic 202. The kernel driver logic 512 executes at a 
higher privilege level than the application level graphics driver logic 
506 and may more directly affect the operation of the graphics 
subsystem 1 14. Second application logic 204, substantially similar to 
the first application level graphics driver logic 506, may be linked with 
application level graphics driver logic 507. In other words, multiple 
applications may link with multiple instances of the application level 
graphics driver logic, each of which communicates with the graphics 
subsystem 1 14 via the kernel driver logic 512. 

[0035] The first application level graphics driver logic 506 comprises 
command processing logic elements 515, 514, and 516. Command 
processing logic elements 514, 515, 516 may be invoked in response 
to a graphics commands from the application logic 202. For example, 
a first graphics command from the application logic 202 to draw a line 
may invoke command processing logic 515. A second graphics 
command to draw a circle may invoke command processing logic 
516. A third graphics command to fill a region may invoke command 
processing logic 514. 

[0036] The second application level graphics driver logic 507 comprises 
command processing logic elements 520, 521, and 522 to process 
commands from the second application logic 204 in a substantially 



8 



Attorney docket: FSP0050 

similar fashion as command processing logic elements 514-516 
process commands from the first application logic 202. Each 
application level graphics driver logic 506, 507 may comprise 
additional command processing logic elements, and command 

5 processing logic elements may comprise logic in common. 

[0037] Command routing logic 508 routes commands from the 

application 202 to the appropriate command processing logic element 
514-516. In other words, commands from the application 202 invoke 
the command routing logic 508, which invokes the appropriate 

10 command processing logic element 514-516 of the application level 

graphics driver logic 506 to carry out the command. The command 
routing logic 508 comprises jump logic 527, 528, and 532 to invoke 
the command processing logic element 514-516 corresponding to a 
command from the application logic 202. In other words, in one 

15 embodiment the command routing logic 508 comprises a jump table 

with entries providing a correspondence between commands from the 
application 202 and command processing logic elements of the 
application level graphics driver logic 506. The jump table may also 
be referred to as a thunk layer. The command routing logic 508 

20 further comprises return logic 538 to cause a command from the 

application 202 to return without performing substantial processing 
and without providing the application 202 with an indication that the 
command was not processed and/or resulted in an error condition. In 
other words, the routing logic 508 "stubs out" the processing of the 

25 application level graphics driver logic 506. The purpose and operation 

of the return logic 538 is described more fully in conjunction with 
Figure 7. 

[0038] Command routing logic 510 comprises jump logic 526, 533, and 
534, and return logic 540, to perform routing operations for command 
30 of application logic 204 similar to those routing operations performed 

by command routing logic 508 for application logic 202. 
[0039] Figure 6 is an action diagram of an embodiment of error handling 
for a graphics processing scheme. At 302 the application provides a 
first graphics command to the application level driver element. At 602 
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the application level driver provides a driver command to the kernel 
level driver. At 304 the kernel level driver provides a device command 
to the graphics subsystem. At 402 an error occurs in the graphics 
subsystem. At 404 the graphics subsystem provides an error ' 
indication to the kernel level driver. At 604 the kernel level driver 
provides an error indication to the application level driver. However, 
the application level driver does not report an error indication to the 
application. 

[0040] Instead, at 606 the application level driver causes 

reconfiguration of the routing logic. The application has no indication 
that an error has occurred in the graphics processing, hence, at 308 
the application provides a second graphics command to the 
application driver. Due to the reconfiguration of the routing logic, at 
608 the application driver returns to the application without invoking 
command processing logic to carry out the second graphics 
command. In other words, the command processing logic 
corresponding to the second graphics command is stubbed out, and 
the application level driver returns processing to the application 
without an error indication or indication that the command processing 
was not carried out. 

[0041] Thus, at 314 the application provides a third graphics command 
to the application level driver. At 610, due to the reconfiguration of the 
routing logic, the application level driver once again returns to the 
application without invoking the command processing logic. The 
application may continue to provide graphics commands to the 
application level driver, until such time that a graphics frame has been 
configured and is ready for display. 

[0042] At 320 the application provides a display frame command to the 
application level driver and then at 326 provides a device status query 
to the application level driver. At 410 the application level driver 
provides to the application an indication of the error that took place 
earlier in the graphics processing. At 614 the application provides one 
or more commands to clear the error condition, and at 616 the 
application attempts to reconfigure the frame. Clearing the error 
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condition may result in the application level driver reconfiguring the 
routing logic so that commands from the application once again 
invoke corresponding command processing logic elements of the 
application level driver. 
[0043] Figure 7 is a block diagram of an embodiment of a logical 
arrangement for a graphics processing scheme in which an error 
condition has arisen. The command routing logic 508 is configured to 
cause the jump logic 527, 528, and 532 to invoke the return logic 538 
to cause commands from the application 202 to return without 
performing substantial processing and without providing the 
application 202 with an indication that the command was not 
processed and/or resulted in an error condition. In other words, the 
routing logic 508 "stubs out" the processing of the application level 
graphics driver logic 506. Likewise, the command routing logic 510 is 
configured so that the jump logic 526, 533, and 534 invokes the return 
logic 540, thus stubbing out processing by the application level 
graphics logic 207. 

[0044] Figure 8 is a timing diagram embodiment comparing application 
and driver processing times for normal and error conditions. At TO the 
application begins processing to configure a graphics frame. The 
application invokes the application level driver to process three 
graphics commands (the number three selected merely as an 
example). The first command is processed from T1 to T2, the second 
from T3 to T8, and the third from T9 to T10. Due to the processing 
times of the driver, the application takes from TO to T1 1 to configure a 
graphics frame. 

[0045] If an error occurs during the configuration of the frame, there is 
not enough time before the VBI interval begins at T13 for the 
application to reconfigure and display the frame. Thus, a frame could 
be dropped or delayed, resulting in display inaccuracies. 

[0046] If an error occurs in the processing of the first graphics 

command, the driver reconfigures the routing logic so that command 
processing time by the driver is substantially reduced. For example, 
the driver may stub out command processing, without providing the 
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application with an indication of the error condition. Thus, driver 
processing in response to the second graphics command is 
substantially reduced to the interval T3-T4, and processing of the third 
graphics command is reduced to the interval T5-T6. Thus, in the 
presence of an error condition, the application processing time to . 
configure a frame is reduced to the interval T0-T6. At or near T6 the 
application receives an indication of the error condition, and there is 
time enough between T7 and T12 to reconfigure the graphics frame 
before the VBI interval begins at T1 3. 
[0047] Unless the context clearly requires otherwise, throughout the 
description and the claims, the words "comprise," "comprising," and 
the like are to be construed in an inclusive sense as opposed to an 
exclusive or exhaustive sense; that is to say, in the sense of 
"including, but not limited to." Words using the singular or plural 
number also include the plural or singular number respectively. 
Additionally, the words "herein," "above," "below" and words of similar 
import, when used in this application, shall refer to this application as 
a whole and not to any particular portions of this application. When 
the claims use the word "or" in reference to a list of two or more items, 
that word covers all of the following interpretations of the word: any of 
the items in the list, all of the items in the list and any combination of 
the items in the list. 
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